Cost-Aware Traffic Management under Demand Uncertainty From a Colocation Data Center User’s Perspective

Burstable billing is widely adopted by colocation data center providers to charge their users for data transferring. This paper propose a cost-aware traffic management approach for a colocation data center user under burstable billing where it is charged based on the 95th percentile bandwidth usage. To do this, we first develop a tractable mathematical expression to calculate the 95th percentile usage of a user. Then, we develop an optimization problem to maximize the user’s surplus based on both deterministic and stochastic predictions of the user’s demand. We show that the resulted optimization problem, while non-convex by nature, can be efficiently solved or approximated using a convex program. We also show that the proposed approach can also be applied in a more general scenario where the user gets services from multiple service providers. Using real-world workload traces, we show that the proposed approach can reduce a colocation data center user’s IP transit cost by 26% and increase its total surplus by 23%, compared to the current practice of allocating bandwidth on-demand.